Correlation Time Scales in the Sherrington-Kirkpatrick Model 
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We investigate the dynamical behavior of the Sherrington-Kirkpatrick mean field model of spin 
glasses by numerical simulation. All the time scales r x we have measured behave like \ii(t x ) oc iV e , 
where -/V is the number of spins and e ~ |. This is true whether the autocorrelation function used 
to define t x is sensitive to the full reversal of the system or not. 



Today many features of the Sherrington-Kirkpatrick 
mean field model of spin glasses have been clari- 

fied. Probably most questions that still need investiga- 
tions are related to the very interesting dynamics of the 
model (see for example H|). Here, following Mackenzie 
and Young [^J, we examine the equilibrium dynamics of 
the model. In this classic paper the authors gave numer- 
ical evidences, from systems with up to 192 spins, for 
the existence of a spectrum of relaxation times which di- 
verge with the number of spins N as ln(r) oc N~ , and of a 
second, longer "ergodic" time scale T eg which is the time 
needed to turn over all the spins, with < ln(r e9 ) > oc . 
For doing that one looks both at processes that require 
a full reversal of all the spins and at processes that on 
the contrary are not sensitive to this phenomenon. In 
this letter, we establish that indeed all dynamical scales 
have the same behavior, compatible with barrier heights 
growing like N e , where e ~ 0.3 close to the behavior 
suggested in ]6|,|8| (see also the numerical simulations in 

0)- 

Let us start by giving some details about our simu- 
lation. We study systems with N = 64, 128, 256, 512, 
and 1024 spins, with ±1 couplings. We first thermalize 
the system using the parallel tempering optimized Monte 
Carlo procedure |J with a set of 38 T values in the range 
0.4 - 1.325 (i.e. AT = 0.025). We perform 400000 it- 
erations (one iteration consists of one Metropolis sweep 
plus one tempering update cycle), and store the final 
well equilibrated configurations. Next we start updat- 
ing these equilibrium configurations (more precisely the 



1 Notice that while T2 and T3 are unambiguous signatures of 
the transition to the reversed part of the phase space, n can 
be ambiguous, since depending on T it can still characterize 
a transition in the short time regime or already an ergodic 
transition. The fact that the three n turn out to be com- 
patible gives further support to the existence of a single time 
scale exponent e. 



subset with T — 0.4, 0.5 , . . . ) with a simple Metropolis 
dynamics, and perform 4 • 10 6 Metropolis sweeps. We 
have in all cases two replica and 512 realizations of the 
disorder. 

For each of these samples we compute the flip times 
Ti, T2 and T3. We define t[ J ^ as the time after which, on 
a given sample J, the time dependent self-overlap 

«(M) = ^l>(oy<(t) (i) 

i 

has become smaller than +S, with 

£ = VWTi , (2) 

where (q 2 }j, the usual square Parisi overlap, is computed 
during the second half of the thermalization run for the 
given sample. The time t is measured in units of sweeps, 
with t = at the beginning of the Metropolis dynamics. 
We define analogously r 2 as the time it takes to q(0, t) to 
decay from its initial value of 1 down to 0, and T3 as the 
time it takes to q(0,t) to decay down to — S. 

We expect 1 n, T2 and T3 to obey the same scaling law. 
In the following we will try to check if an exponential 
scaling of the kind 

n,2,3 - ^1,2,3 exp (ai j2 , 3 ^ e ) (3) 

gives a good fit to the data, and we will try to determine 
e. 

We base our analysis on empirical medians for ln(r), 
i.e. we sort the 512 values of ln(-r) asln(r^°- ) ) < ln(r^^) < 
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. . . < ln(r( 511 )) (more precisely the 512 values of ln(r) 
averaged over the two replica) and define the median as 
ln(r( 255 )). For large N and small T, the probability dis- 
tribution of t has a very long tail (for large values of r) , 
and in many cases we are not able to compute average 
values, since for some samples r is larger than the num- 
ber of sweeps performed. On the contrary, the median 
approach works, and allows a fair estimate. In all cases 
where we are also able to estimate the average value of 
ln(r), wc find that it is very similar to the median value. 
Thanks to this approach we have been able to estimate 
T\ on all our lattice sizes down to T = 0.4, down to 
T = 0.5 and T3 down to T = 0.6. Statistical errors have 
been computed using the usual bootstrap procedure. 

The second decay time of interest is the time scale 
that governs the decay of, for example, the square 
(time-dependent) overlap. We monitor the decay of 
< q(0, t) >j and of 



^)E<g2( 0j t)> J -( g 2) J 



(4) 



and we call r q and r q2 the time scales that characterize 
the short time decay of these objects (see later for details 
about the exact definition). 

Let us start by the results for r%, r 2 and T3. In figure 
(|l|) we plot one of our most successful fits of t 3 : here we 
are at T = 0.6, the fit is very good and we estimate 
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FIG. 1. Points with errors are for ln(T3) versus N, and the 
continuous line for our best fit to the form (^|). 

e T3 (T — 0.6) = 0.25 ± 0.04 , (5) 

that can be compared to 

e n (T = 0.6) = 0.20 ±0.16 ,e r2 (T = 0.6) = 0.19 ±0.07 . 

(6) 

Our estimates for e T1 , e T2 and e T3 turn out to be very sim- 
ilar. The general pattern that emerges from these fit is of 
a very good consistency. Let us go in some more details. 
Fits to e T3 (here, as we said, we wait for q becoming nega- 
tive and equal to — E) are available only down to T = 0.6 
(at lower T values T3 is too large and we are not able to 



estimate at all e T3 ). For T from 0.6 up to 0.8 the best fit is 
very stable with an exponent close to 0.25 — 0.30. When 
going too close to the critical point the behavior becomes 
less clean. e T2 (where we wait for q becoming zero) can 
be determined down to T = 0.5 ( t-i is smaller than T3). 
Here fluctuations are slightly larger than in the former 
case, but again up to T = 0.8 the exponent fluctuates in 
the range 0.2 — 0.3. In the e Tl case (where we only wait 
for q decreasing from 1 down to +£) we succeed to get 
a good estimate down to T = 0.4. Again here, for exam- 
ple, we estimate e Tl (T = 0.4) ~ 0.25, and we get a quite 
stable fit in T. We remark that when T approaches T c 
the estimates of e Tl 2 3 have large errors: a becomes very 
small (one expects a — ► for T — > T c ) and the leading 
N e behavior cannot be distinguished, with the present 
range of system sizes, from sub-leading corrections. It is 
also important to notice that our data fully confirm that 
different ways to estimate the correlation times (the 1, 
2 and 3 r's) lead to the same scaling behavior, with a 
scaling exponent close to ~ 0.3. 
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FIG. 2. ql{t) versus ln(t) at T = 0.6. 



Let us notice here (and this is the focal point of this 
note, that we will discuss better in the following) that the 
result of equation (0) does not manifest, as opposite 
to the findings of ||, a scale of the order of exp(cN^). 
The scale we observe is governed by an exponent close to 
0.3. 

We discuss now the measurements of correlation times 
that do not involve the reversal of all the spins. As 
an example we plot in figure (||) q^(t) versus ln(t) at 
T = 0.6, and in figure (|^) the same quantity at T = 0.4. 
The two figures exhibit two regimes separated by some 
crossover value t max : a small time regime, where q\ (t) de- 
cays slowly with ln(t), and a large t regime where cfc(t) is 
very small. This is very suggestive of the existence of a 
whole spectrum of relaxation times, up to some maximal 
value ~ t max . 

We have defined the correlation time r q2 by computing 
the time needed for ql(t) to decrease from the value 0.25 
to a threshold value T that we vary (reference || was 
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looking directly to the moment in which q^(t) is close 
enough to zero) 2 . In the case of g 2 (i) we have used the 
two threshold values Ti = 0.125 and T 2 = 0.050. 

The exponents we estimate by best fits to the form 
(||) arc again quite stable (even if in this case we have 
not been able to produce reliable error estimates) and, 
let us note right ahead, if any they are larger than the 
one estimated for the full reversal times 71,2,3: we can 
be quite precise on the claim that the scenario where a 
slower time scale governs the full spin reversal while a 
faster time scale governs the valley to valley migration 
does not apply. As an example we plot in figure || the t^, 
time as a function of N, and our best fit to the form (g) 
at T = 0.4 and for a threshold T2 — 0.050: the estimated 
exponent is here 0.38 ± 0.05. The exponent values are 
very stable when changing the value of the lower thresh- 
old, that is a very good sign. In the T range 0.5 — 0.8 
the estimated value of e are in the range 0.28 — 0.38, i.e. 
completely compatible with the value i that is reasonable 
from a theoretical point of view (see for example |^,||). 
The quality of the best fit degenerates again when T be- 
comes too close to T c . It is maybe worth to stress here 
that the determination of the exponent e is a very diffi- 
cult problem, exponentially more difficult than the usual 
determination of critical exponents, since here instead of 
a power behavior we are trying to fit an exponential to 
a power behavior: if r is ranging over 5 order of magni- 
tudes (that would be more than acceptable for a power 
fit) its logarithm is ranging over half a decade only, that 
gives a poor basis for our fit to the exponential of a power 
law. 
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We have also measured q(t), that we plot in figures || 
and H for T = 0.6 and T — 0.4 respectively. At large 
times q(t) goes to zero, on the contrary we expect the 
initial decay to be governed from the same process that 
determines the decay of ql(t). It is also interesting to 
note that we are observing the expected plateau at the 
Edwards- Anderson value of the self-overlap, qEA'- with 
good approximation one estimates [0 qEA(T = 0.6) ~ 
0.50 and q E A(T = 0.4) ~ 0.74. These two values co- 
incide very well with the locations where on our larger 
lattice we see a plateau: this is very clear at T = 0.4 in 
figure ^ and a bit less clean but also evident at T = 0.6 
in figure 0. The finite, large system, spends a long time 
at qEA before having q(t) — > because of the ergodic 
transition. 




FIG. 3. ql(t) versus ln(t) at T = 0.4. 
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FIG. 4. Data points are for ln(r 92 ) (without error-bars) 
versus N, and the continuous line for our best fit to the form 

We have checked that by fitting with the same proce- 
dure used for q^(t), using this time the q interval going 
from 1 down to 0.63 (we use a higher low threshold to stay 
far from the actual decay to zero). Things work well, and 
we fit a scaling exponent for the correlation times statis- 
tically compatible with the one obtained for q^.(t). We 
show in figure [?] the analogous of figure ^, where the best 
fit gives e Tq = 0.34 ± 0.02 (again, very well compatible 
with the value |). Consistent results (slightly lower, of 
the order of 0.25) are obtained at higher T values. 

It is clear from the figures we have shown that q(t) and 
<7c(t) decay very slowly to zero, on a logarithmic scale. 
We try to be more quantitative in figure ^, where we 
show that the q^(t) data are very linear when plotted, 



2 It is important to note that the ergodic correlation times n 
and these r q2 , r q are defined in very different ways, and none 
of them as a simple, bona fide coefficient of an exponential 
decay e _t,/T . The fact that we find that they satisfy reason- 
able scaling laws shows that the definitions we use are well 
founded. 
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for example, as a function of ln(t)@ , with [3 = 0.25: we 
do not consider that as a fair determination of /?, since 
there is a large range of value of (3 that make the plot lin- 
ear. What we can claim is that (3 is surely a small value, 
of the order of magnitude of 0.25. At higher T values we 
have the same kind of behavior. 
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FIG. 5. q(t) versus ln(i) at T = 0.6. 



FIG. 7. Data points are for ln(r,j) (without error-bars) ver- 
sus N, and the continuous line for our best fit to the form (ph . 



In figure ^| we show, for our largest system, ln(r g2 ) as 
function of T . The data are very well explained by the 
fact that we expect an Arrhenius like behavior, exp(4), 
with A ~ (T c — T) [[| : a coefficient proportional to Tc ~ T 
fits indeed the data very well. 

We can sketch a few conclusions. In the Sherrington- 
Kirkpatrick mean field model of spin glasses one sin- 
gle time scaling dictates the behavior of the correlations 
times related to the complete reversal of all spins and to 
the transitions through the different states that consti- 
tute the phase space: the speculation suggesting that one 
could get two different scaling laws is not founded. It is 
not easy to get precise values for the exponent that char- 
acterizes this exponential scaling, but all our findings are 
compatible with a e = 3 scaling: this is consistent with 
barriers scaling like AT 3 We have also been able to 

show that the connected squared overlap decays to zero 
with a power of the logarithm of the order of 0.25 (and 
clearly not like a power law). 
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FIG. 6. q(t) versus ln(f) at T = 0.4. 



0.35 
0.3 

0.25 
0.2 

0.15 
0.1 

0.05 




0.8 



ii 



1 if 



1 ' r** 



1?? 



L=64 
L=128 
L=256 
L=512 
L=1024 



i u % "m*. 

1 i ? % «% 



1.2 1.4 1.6 

log(t)**0.25 



FIG. 8. ql{t) versus ln(t) - 25 at T — 0.4. 
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FIG. 9. ln(r 92 ) versus T for N = 1024. The behavior close 
to T c — 1 is very linear, while at smaller T values the increase 
of ln(r 92 ) becomes sharper. 
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